


f 


. ——S 


j! S nN 
iby 4 ‘ ts Me , 









Institutional Archive of the Naval Postgraduate School 


Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


1964 


An Investigation of Solutions to Allocation Problems. 


Clark, Bernard E. 


Monterey, California: U.S. Naval Postgraduate School 


http://ndl.handle.net/10945/12478 


Downloaded from NPS Archive: Calhoun 


| Calhoun is the Naval Postgraduate School's public access digital repository for 
_ (8 D U DLEY research materials and institutional publications created by the NPS community. 
«ist | et Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS's first 
TT \ KNOX appointed -- and published — scholarly author. 
http://www.nps.edu/library 






LIBRARY 


Dudley Knox Library / Naval Postgraduate School 
411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 


) - wnny H 2 - 
wk! a, - 
am f 
> 2 
’ 
» 
‘ 
9 e : 


NPS ARCHIVE 


1964 ‘ Dae pte) ay | | 3 
CLARK, B. Rs re . BO ss | : 








| ah 
AN INVESTIGATION OF SOLUTIONS 
TO ALLOCATION PROBLEMS ~ 
: BERNARD E. CLARK 
{ 
4 ; ar 
| | UB. 
’ , ae 9 aes Ani 
; : | . is 
| ’ 
z ae ei ae RTT TS tar ane pa oN | 
a | Sa eee : 2 ies eee te *, 
ait ae 


« ow’ fad Secs 
ste are 4 nian or ie 
Mee teeta 


sitet tea Se | a 


yo HRD 





DUDLEY KNOX (IGRARY 
NAVA POSTGRADUA™ = SCHOOL 7 


MONTEREY CA 939035101 


a 


Sam eese! postgraduate school 


Es 


yey ie CY) Califorma 











a. 











alia 


AN INVESTIGATION OF 


SOLUTIONS TO ALLOCATION FROBLEMS 


ys 2 oe ie x 


Bernard E. Clark 








AN INVESTIGATION OF 


SOLUTIONS TO ALLOCATION PROBLEMS 


by 
Bernard E. Clark 
y, 


Captain, United States Marine Corps 


Submitted in partial fulfillment of 
the requirements for the degree of 


MASTER OF SCIENCE 
IN 
OPERATIONS RESEARCH 


United States Naval Postgraduate School 
Monterey, California 


ie? 6.4 





DUDLEY KNOX LIBRARY 
Library NAVAL POSTGRADUATE SCHOOL 
U.S. Naval Postgraduate SchdWONTEREY CA 572 | 
Monterey, California 


3-57Q7 


AN INVESTIGATION OF 
SOLUTIONS TO ALLOCATION PROBLEMS 
by 


a Bernard E. Clark 


This work is accepted as fulfilling 
the thesis requirements for the degree of 
MASTER OF SCIENCE 
IN 
OPERATIONS RESEARCH 
from the 


United States Naval Postgraduate School 










eT a ae 


i747 
oo 4° <n swackary lp 


2 falas TD 
Vira 


© 





Xe: 
‘333 Dione = 


aecceh3ind aa besgnsoen et tzoy epay 
te eeeget ots 20? bjesma71uper wheats ela 
SOM3T>2 TO SATAN 
at 
TASC BKORTARAYO 
e453 2677? 


+OC82. ethubwsgi¢09 [evel 293492 Bextatl 


ABSTRACT 

During the past ten years there has been increasing interest in 
the solution of allocation-type problems. Published papers on the 
analytical solution of such problems have in the main been restricted 
to particular cases. 

This paper, while not offering an all-purpose algorithm, addresses 
the problem in general through the development of theorems giving 
necessary conditions for a given vector or function to be a solution. 
These conditions in many cases enable one to deduce the solution. 

The paper is presented in two parts. The first addresses the 
problem of maximizing a sum of n functions over an n-dimensional sim- 
plex. The second is concerned with the maximization of the (Lebes gue) 
integral of a functional over a class of integrable non-negative func- 


tions with common L, norm. 
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L, Introduction. 

During the past ten years there has been an increasing interest in 
the solution of allocation type problems -- problems that are concerned 
with the distribution of available resources in a manner that will maxi- 
mize some sort of utility or payoff function. The resources may be 
defined in terms of men, materials, money, weight, or a myriad of other 
conceptual products over which some individual has control. The payoff 
may be in terms of dollars gained, losses to an opponent, expected value 
of a random variable, probability of the occurrence of an event, or 4 
mixture of these and other factors. 

A fairly large literature has grown up around these allocation 
problems as they apply to many fields of endeavor such as target assign- 
ment, theory of search, theory of games, etc. However, most of what has 
been published has been in the form of particular solutions to particu- 
lar problems (or classes of problems). 

It is the purpose of this paper to set forth certain theorems which 
appear to be at the heart of nearly all analytical solutions to alloca- 
tion type problems. The theorems in Section 2 are not by any means 
original but have been used by mathematicians for years. These and 
Theorem V of Section 4 were first introduced to the author by Dr. J. M. 
Danskin of the Institute of Naval Studies in his lectures at the U. S. 
Naval Postgraduate School in the spring of 1963. Theorems VI, VII and 
VIIL, while apparently never before published (at least not in this 
form), will be readily seen to be extensions of the basic concepts of 
Theorems II, III and IV respectively to the case of the Lebesgue imte- 


gral over En’ 





It is hoped that a study of the theorems and examples of this 
paper will prepare the reader who is concerned with the analytical 
solution of allocation type problems to better extend the reasoning 
of the authors of papers attacking certain special problems, many of 
which are referenced, to his own particular problem or problem area. 

The order of development in this paper will be as follows: 

First, four theorems concerning the solution of finite allocation 
problems will be developed. 

Second, two examples of applications of the first four theorems 
will be worked out and a discussion of appropriate published references 
will be presented. 

Third, four theorems and a lemma concerning the case of the cone 
tinuum will be developed. 

Fourth, two examples and a discussion of published references will 
be presented. 

I would like to express my gratitude for the encouragement, guid- 
ance, and inspiration which Professor Kenneth Lucas and Dr. John Danskin 


provided and without which this paper would not have been possible. 





on the Finite Allocation Problem. 

In this section we shall develop four theorems concernimg the ana- 
lytical solution of problems in which one desires to maximize the re- 
turn from the allocation of a fixed resource among a finite number of 
activities each of which has associated with it a known return function. 

Suppose we have a finite number, n, of activities to which we wish 
to allocate resources available in a fixed quantity K. Suppose further 
that associated with each activity there is a function representing our 
gain upon allocation of resource to that activity. That is t. (x) is 
the gain realized from the allocation of an amount x of our resource to 
the i'th activity. The problem we are concerned with is to maximize 
our total gain by the proper allocation of our resources. That is we 
wish to find the n-dimensional vector x° = Ce ee that maxi- 
mizes £ i (x5) subject to the constraints x= 0 for all i and 

=1 


yx, - X where x, represents the allocation to the i'th activity. 
i 
c=Z 


Since the properties derived in the theorems are independent of X, 
or the x, 'S can be normalized, we shall assume henceforth that X = l. 

We shall also assume that the functions f, are twice continuously 
differentiable (the derivative being taken from the right at O and from 
the left at 1) in what follows. [In all but Theorem IV this restriction 
is excessive. For the reader who encounters problems not meeting the 
above condition the allowable reduction of the restriction in Theorems 


1, 11 and III is readily apparent. 





a = o © Ae 
Theorem I. If x° - (x, Xo pe0-5X, ) maximizes 


n n 

£.(x,) subject to ) x, - 1 and x,=0 
Ye, i? j i-~ iy 6 
Cz1 (22 


then there is a number J such that; 
= \if x, = 0 
—" Serif x. = "0 

7 i 

(The problem and constraints set forth in the above hyvothesis 


shall be referred to as "the basic problem" throughout the remainder of 


this section. ) 


Proof. 
Suppose x, > 0. Then construct 
€ - Oo . = < © 
xi = OX € where o=€ Ex, 
x such that: eo eet for same j 
ie fees 
Eo Men for’ kita. 
k k : 


Obviously x* is admissible. (Throughout this paper the tenn 
admissible will refer to a function that satisfies the constraints 
applied in the statement of the problem to functions which may be con- 


Sidered a solution. ) 


=O e 2 o a 5 \ 
Since x maximizes the above sum F(€ ) achieves its maximum when 





£& = O and so we must have F(E) = 0; 
€=0r 
b ° >! = : oO -f'fy OF= 
ut; F (E) fi Cx, ) f(x, = 0 
Exot 








implies that (1) £0459) SE (x9) for any j#i 


We now observe that if for some j#i, x,°m 0, we can by the same 
J 
method obtain the reverse inequality, thus giving us: 


£i(xVS f£'(x 0°) for x %0 & j#i 
J J i 
£5(x,°) = pe for x, Om 0 & ae 0. 


Taking 2 to be the common value of f(x, °) for those x° which are 
i 
positive the theorem is obtained. 
Theorem II. Given the basic problem, if all the ‘ are strictly concave 
(f£5(x)<0) and HP = (%)O,%)% oo X °) yields the maximum, then there is 
n 

a number X such that x,°>0 if and only if £ (o>) ‘ If £ (O)> Xs 
then x,° is the unique solution of the equation £7 (%,°) =). 

Proof: 

Apply Theorem 1. If xO 0, we see that f(x,0) = 
but since f(x) =0, fi is strictly decreasing in x so that 
§ § = 
TCO) are ac, ° r= r- 

On the other hand suppose £i(0)>) - Theorem I states that if 
xo - 0 then f (O)= r hence x “> QO and the if and only if statement 
is proven. 


To finish the proof, suppose £ (O)=) . Then x Os 0 and from 


Theorem I £+(x,°) =) . That there is a unique solution to this equa- 
tion follows from the fact that £; (x) is strictly decreasing in x. 
Theorem III. Given the basic problem, if all che f 


t 
as ee a i 


(£5 (x)= 0) and x° - (%,9,,%59) +» 9) yields the maximum, then there is 


are strictly convex 


an i such that x,° =: l and * 5° - 0 for j#i. (Geometrically, the 





solution lies on a corner of the simplex.) 

Consider any admissible Xs Ce ako toe) such that at 
least two, say x, and a of its components are positive. We know 
(since X is admissible) that x < 1 and a ls 
Take € >O such that: 


- =~ 0 
x, € 


. -€ >O 
et € 
x, +€ == | 


: 1 
sna <= 


1 2 


Define x and x’ as follows: 


= i 
x5 = Xj € 


| 
3 ~ x te 


L aa 6 * 
x EX POLE Le) 


rad 
NO 
ve 


ie Teter = 


“ 
N 
i 


ee 


2 


ee -SakE for k#i,j 


xt and aa are admissible and furthermore: 


Xe 
2 


we may now write: 


h n 
DE 4Cx,) = df 
(=Z 


cel 








The inequality holds because each of the f, is strictly convex and 


i 


n a. 
—-. 4 
x and *%2 differ. Hence ) £04) must be less than ) fh 
C=2 c=2 


or less than \ £46%,2) or both and thus % does not yield the maxi- 
aw A 

mum. Thus if *° is not a corner of the Simplex , x? is not the solu- 

tion. 

Note: The solution for the above case is not necessarily unique. That 

is, more than one corner of the simplex could yield the same maximum 

value. However, we can see that all that is necessary to solve the prob- 

lem for the convex case is to evaluate each f; at x, = 1 (or X if we 

have not normalized) and select that activity which yields the highest 

return, 

Theorem IV. Given the basic problem. If Ro = (KOK QI 5-0 XA?) is the 

maximizing solution, then f/(x,;°)50 for all x,° which are positive, 

with at most one exception. 

o 


Proof. Suppose we have an admissible xo with 


1°) on " O\=> " Oy»v>Q, 
x,°r0, x, 0, f(x, }>0O and BGs, y= 0 


Let 
oo 


re) fe) 
X# X, 
L J 


E 


‘ oO oO 
min (xX, 5 Xo ) 


Now consider the problem: 


(1) Maximize EGE ee Cs) subject to 


> > . 
x,=9,x,;=0 & Ae aa ¢ 


L£ K° maximizes the original problem, we see that the pair 


(x,°, eo must provide the solution to (1). 


7 





Since both f' and a are continuous, we can find a d > 0 such that 
6<€and for IMl= & we have Ese, 4H }>=O and ECS #N y>0. 

(This is the only place we utilize the full power of the constraints 
placed on the £.'S-) 

Let F(? ) - Cray ate -N).- For INl<6 we have 
aif )=0O so that F(7) is convex and achieves its maximum on the in- 
terval I-65, 5| at N= -f or at Uc but since 
(77) Cx,” -%)=@ this shows us that (x 9,%,°) can not be the 
solution to Problem (1). Thus any such = can not yield the maximum 


to our original problem. 





2. Examples of the Finite Problem. 

The theorems of the last section or variations of them have proved 
useful in a large number of mathematical applications. Included in these 
"allocation" problems are weapons assignment, solutions to games, and 
many other problems concerned with the optimum distribution of effort or 
resources. 

it is the purpose of this section to illustrate through simple ex- 
amples the application of the theorems of Section 2 to the solution of 
problems. References will be given to several papers and books which 
treat similar problems by this method and also to several which contain 
a different approach to the solution to these problems. 

Example 1. (This example is based on a problem posed by Dr. John 
M. Danskin of the Institute of Naval Studies in his lectures om Search 
Theory during the spring of 1963.) 

Suppose in the problem described prior to Theorem [I we let the n 
activities be interpreted as n available targets while x, represents the 
number (of a fixed number X) of weapons we allocate to the i'th target. 
Suppose the probability of destroying the i'th target with x weapons is 


a 
eran oe 


where b; > 0 is a parameter representing weapon reliability, 
accuracy, target defenses, etc. Suppose further that the destruction 
of the i'th target results in a gain to us of a,> 0 units. We now de- 
sire to allocate our weapons in such a manner as to maximize our 
expected payoff (gain) with respect to the probabilities of destruc- 
tion. Our problem then is: 


n 
i opis 
mSXimize ae y 
C=Z 





Subject to: x =Oebloneahl i 5 


Ke at X 
fess & 
by letting Y; = vi we can normalize this problem and rewrite it: 
maximize Va (1-e Pit ) 
Sis 


subject to: y,20 for all i 


n 


y= 


az 
where ys represents the proportion of our total arsenal X that we 
allocate toe the i'th target. In this example we shall determine the 
solution for both variations to show that they are indeed the same. 
(we shall adopt the notational scheme of numbering equations for the 
first problem and using the same numbers with a prime for the analogous 
equations for the second problem.) 


We now haves: 


~b.X- 
CIDE REC. 25a, Clee * sy 


(2) £3 (xy) = agbje 
(3) £2(x,) 2 -a,b : ee 0 for all i & x20 
yh ee ii or a R& x= 0 
' “bik yi 
and: (1') gy (y,) = ay(l-e > 
-b;Xy 
' ' = i i 
(2°) 8 yy) = ayby Xe 
sul ta 2.2 ~Pi* M4 
Cr B.CY,) = -a;b,“X"e <Q for all i & 0 


10 





We shall now let Cc, - b. xX , 
Since CBs for all‘i & x and B.(yj< 0 for all t & Y, we see 
that Theorem II applies in both cases. So we calculate: 


(4) £. (0) = a,b, 
(4°) gi(0) = aye, 


and the application of Theorem II gives us; 


x, > 0 iff aybi>A,, 


So * 
oO. : <= 
Xs - 0 iff ajb,=), 
y= 0 Lee aC > 
(5') 


Oo. ° 
Ys -O iff acs 5 


We see from (5) & (5') that if the solutions are equivalent we must 
have Ay = ee 
Now applying the second half of Theorem 11 we obtain; 


for all i such that x o> O: 


oO 

-bex 

: Oi as Tae & 
f(x, ) = agby e AG 


or after multiplying by Lfa.b, and taking logarithms of both 


sides: 


ayby 


1 
(6) X od -— In 
be 
a i \.. 


Similarly for i such that Ya 0: 


0) o 
Ce f= 1 in 2ici 


Cc. ee 
i Ay 


We now re-label the targets so that a,b, = apby 5... Ea,b,. For 


Ll 








any ve we find its position in this string of inequalities. (No- 
tice that ee must be less than ab, Since otherwise we would have 


all x, = 0.) Having chosen Xr we set 
i x 


oO < 
me or a.b. — yi 
Ke eee, of y>; = 


L 
(7) 
ibe 
OMe nas ied 


by AG 


We now var to obtain: 
Yipes 


a ue ; a,b, 
(8) Apres b = [oa 
i 1 le 
3ab.>Ax 
Similarly using the same ordering (a,b, > a,b? a,b, X = a,c.> aC, 


> a,b. X), we obtain for the second problem: 


ae 
° 
yY; = 0 for acy=), 
C7") 
a) it a:C. 
ae =, In ie , for ac> 
i y koi MA 
and we vary to obtain: 
Ay 
ac 
(8') \ 9° os c, | i eee 
= 7 
A (32:GdAy 
Substituting for Cc, into 8‘' we obtain 
i a. bs X 
Bx In ~Li’ : 1 
: y 
€ 32;6:X> Ay 
1 a:b. 
eo ee Pig 
ae L Ay ix = # and we see 
CDa:b:> 


that = ee and the two solutions are equivalent, 
y x 


12 





From this we see that the product ab. is the factor that deter- 
mines whether or not a target is attacked. So, if a new target arises 
we can compute the new product ab and if the new ab is less than A,» 
the new target will not be attacked. If the new ab is greater than Ad 


then it will be attacked and a new vy must be calculated. 
x 


Example 2. 


Consider the two-person zero-sum game with payoff Kernal 


& b= 0 and x & y, are the coordi- 


n 
-b © 
K(X59) = ) ayxye peers a, 
C= 


= 


nates of the n-dimensional vectors *% and Y constrained by x,.,y = 0 
| 


Vv 
for all i and » % =niC 7. ) % = od We might consider the 
p=2 


a,'s to represent target values; the b.'s target defensibilitys; x, the 


i 
allocation of weapons to target i by player I who desires to maximize 
K(x, ¥) > and Ys the allocation of defenses to target i by player [I who 


° ° = = ¢ , ; 
desires to minimize K(x, y). For convenience we shall assume c & d = l. 


: : , ; ® r.0 
The existence of a solution to this game, that is a pair (x .y y such 


=90 


that K(X°, y = K(X ¥°) for all 


—_ 
ws 
Pas 


in the simolex and 


QO 
K(x, 7 )= KR, ¥) for all y in the simplex will not be proved here. 
Such a pair can be shown to exist. 


Our problem then is to find the pair () such thats: 


hi ni 
oO Oo 
(1) » x, -1; YY - 1 
Me c= 
2). ee = Oe y, = for all i 


13 





(3) K(x, ¥°) S xce?, ¥°) S KcR®, Fy, for all xX and ¥ 
satisfying (1) and (2). 
Looking at (3) in the light of the theorems of the last section we 


see we have a pair of maximization problems: 


3 


(4) Maximize K(x, Y°) subject to x, = 1 and 
x, = 0 for all i. ae 
(5) Maximize -K(X°, ¥ ) subject to Y, - 1 and 
y, = 0 for all i. i 
= © 
Upon differentiating K(x, y ) = axe tt by Xs and apply- 
C22 


ing Theorem I, we see that there must be number pi such that: 


= oO =) it x,° = 0 
(6) a, e 
i = ees x, = 0 


aa. 
Similarly from “K(x? Y) we see there must be a number k such that: 


= o 
C7)) canons 0 PAYie oe AN eal 
iid 


A 


k if a = 0 


From an examination of (6) and (7) we can determine the following: 





(a) k>O 3; =There must be at least one i for which x.> 0 
i 


This with (7) gives k>=> QO. 
-b.y,° 
° o~ 5 ; ene play 

(b) y; > o> Xs O35 gle y, > O, then a;b;x,; e 


2 


= k >0 7 cre Os 


oO 
(c) a<)\=> a : O=> y,° = 0.. The first implication follows 


directly from (6). The second is a consequence of (b). 


14 





° } i) oO | 
(cd) 2) 5) ee If a = then Yoo O=> x, = 0 by 


(6); but, by (c) x,° = 0 => ed - QO. 





(e) a, =\ = xo = — ; Substitute y,° « 0 into (7) 
p ee I 





(f) a>) => Toe 0=> xO > 0; This follows directly from 
(6) and (b). 

Now to determine a solution we proceed as follows: 

We see from (c), (d), (e) and (f) that we need only consider those 
e — 
i for which a,= a ; p 
From (6): a >} =a eo! =} 

i i i 

Substituting this into (7) we obtain: 


% 


(8) b. A a ~ k => x,° = Ba for a> ml 


From (e) we obtain: 





(9) x Ss é ee. Alma “4 ° 
1 bea; b.) 
o< K 1 
If we let Z - x,° = sae 
1S as 
CP ace tage =r 
' k 
: > fe) ; ay i 
then x. x, + xs = 6, "seen 
7 CIa> 2 C38g= 2 63a:>A 
Now if we define 8B - tL 
fe) by 
CFQIPA 
as 
sie by 


then for Z = 0 (that is x0 





However, if we set x 5° : = when a =n, » we have: 
i 


yt 


Oo 1 k : ore 

/ ar by = ot By sl >a7k-: By 

(bi) é AS 
CIYZO 


We can thus see that we have 


a) 
Oo . 
ee = l B 


k 
f=7 A : 


we 
IIA 
IA 


(10) 


So we have: 


(LL) 


Ce 


Tw. 
= 5 5 


Using (10) we see that for any value of k satisfying (11) we cam 


find a number with O= “21 5 such that: 
(12) & B +45 B_) l 
oe "LB = 
Recalling the definition of By and By (12) becomes: 


ety eY be! 


CIP >A CIQr=A 


So by settin x.° = k _ , o . k for a. > 9 
y 8 1 5 for as =~ Bi 9 ay a. b: L a 
bj i > 


and a = O for a< A » we obtain a solution for player [. 


~|* 


For player II we have yo > 0 only if a> r » But for a> A 
we have 


_ KK 
iy 


So we get from (7): 


-b,y,° 
b Raa = 
e =k for a>) 


“byy;° = 1. Multiplying by A and taking 


K 
A 
or y S i 
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Logarithms of both sides we obtain 


“biy,” = in om or a ae de in aa 


Thus we can obtain ) as the solution to the equation: 


(13) ‘ a es. " 

: y = oe ati a om 
»¥s bi 
oats CIag SA 


im the same manner dads in Example lL, 


Thus we can express the final solution to the game; 


ree = K/ >; 
for a>) h 
ro} As 
Noe — we in 1 
JL by ~ 
ee = KL 
| D- 
for a, =\ ap 
L 
<r 8 
ba = 
x,° = 0 
for a, <A 
= 0 
Ua = 


were: {a} l a. 
Xr satisfies by MS = 


b3a;>A 
(>) k is not unigue but any number satisfying: 


cs L | K i 


Pee ae? 


A 


CIAD>A (sarvr 


(cy) A is the number for the chosen value of k such that: 


k i kK l 

a ——- + ~— ge = - 

A Ds i >. Si : 
Cahir 


CIAMPA 


| 
| 
WA 
MIA 
| 


Se 
oh 


3 ; ¥ : ~O 20 : : 
Substituting the solution (x,y) into the expression for K we see 


that the "value of the game" is: 





enn ~biyi® 
Tr zee ,y 0) = 25%; %e - Ake 2 


(GW & esd é 


Tne preceding eranies are highly simplified and are meant to serve 
as an illustration of the method of applying theorems [ through IV, not 
as examples of applications. For a much more sophisticated and realis- 
tic application of the theorems the reader is referred to the papers by 
J. M. Danskin on Convoy Routing [e | and Theory cf Reconnaissance [5]. 

For an appraisal of the earlier work done in this field with much 
more severe restrictions on the nature of the problem the reader is re- 
ferred to the papers by Charnes and Cooper [2] and deGuenin [7]. 

The reader has probably observed that the solution obtained by 
application of Theorems 1 through IV will not, in general, provide inte- 
gral assignments. Thus we may be faced with the problem of interpreting 
the meaning of assigning 0.7 bombs to a target. Further, in some cases 
the solution to an allocation problem is very unstable (this is the case 
when the payoff functions f;(x) are S-shaped, first convex and then con- 
cave as x increases). In cases of this type our method may not give us 
any useful information. The paper by Karush fing addresses this problem 
ang contains some very interesting examples pointing up the danger of 
attempting to deduce an integer solution from the analytical solution 
(these examples are readily apparent upon reading the article although 
not specifically referred to therein). Bellman‘s book [1] provides a 
fine computer oriented approach to the solution of allocation problems 


by the generation of sequences of functional equations. Other approaches 


to special types of allocation problems can be found in the papers by 
den Broeder, Ellison & Emerling IP Lemus & David [13], Manne fia] and 
Piccariello [16]. 

18 





4, The Case of the Continuum. 

In this section we shall consider the analog of the problem of Sec- 
tion 2 in which we are allocating our resource over a continuum of 
activities. Examples might be the distribution of searching effort 
(effort spent on a point represented by the velocity at which the point 
is traversed) over an area or the positioning of barrier forces in order 
to protect an installation. Wwe will develop four theorems analogous to 
those of Section 2. 

The following lemma and four theorems are based on Lebes gue meas- 
ure and integrals. In what follows we shall let: 

m be Lebesgue measure 

W be an integrable function 

g be a measurable, non-negative function 

X be the class of all integrable, non-negative functions 
bounded above by g and such that fe = ¢ whenever x € X. 


ALL of the above are defined on EA 





et 


Lemma I. x°€ X maximizes Swe over all x€X if and only if there 
exists a number A such that for almost all t; 
EA) ote xm) 280%) 


PV 3 eee eke) 


(Ly) W(t) 
= A if xt) = 0 
a. Sufficiency. 


Suppose x°(t) satisfies (1). We must show that: 


fucey [2 ce = ce) 2.00 founaliex =X. 
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We can write: 


(2) Juco co - x(t)| = |[wce A |heecey ~ xcey 
since Dbeecey - xe) = AC SAG ee 


We now decompose E. into three disjoint measurable sets: 


n 


{ts wot) =< Af 
Sy = {t: w(t) = A} 
fe: w(t) > Af 


Then (2) becomes: 


wr 
4 


~ 
ww 
ts 


|wce) -A]| x(t) - x(t)| -+ furcey = Al | x2 cey - xcey] 


Sy S5 


+ [wcty -Al [ x(t) - x(t)] 


= 
We observe that: 
On Sy : w(t) -A < 0 and x(t) = Q Thus 
x(t) - x(t)< 0. So, the integrand and consequently 
the integral is non-negative. 
On So : W(t) - A = 0 so the integral is zero. 
On S,: W(t)-ADO and x°(t) = g(t) thus 
x(t) = x(t) 0 and so, aS on Ss) the integral is non- 
negative. 


This proves sufficiency. 


b. Necessity. 


Suppose x°(t) maximizes the integral subject to the con- 


straints of X. 
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We note that Lebes gue measurability is equivalent to approximate 
continuity almost everywhere. (See Munroe fis], p. 292 or Saks faz], 
Deal.) 

Let t, and t be two distinct points of approximate continuity of 
RaW and g such that x(t.) < g(t.) and x (t))79 (ff no two such 
points exist, the problem is degenerate.) 

The following property of a function in a neighborhood of a point 
of approximate continuity is vital to the remainder of the proof. 

If x is approximately continuous at t,, then for any € > 0 and 
M4 > 0 there exists & > 0 such that for any interval I containing CS 


such that m(I)< 4 we have: 


mE NL? ~7% )m (1) 
where a : pe: J x(t) - x(t) JCEF 


Now let us choose 4 = 1/6, an arbitraryo°> 0 , and & > 0 such 


thats: =a Ce) 4€ <~ g(t,) and Gr) - 3E> O. 
Define: 
gs ft: x(t) 2 a(t.) - 3€$ 
W 
EY = ft: W(t) > Wit.) ata 


Ee = ft: et) > g(t,) -€f 
Ba = fe: x(t) > 2E ¢ 

E," = ft: wt) | Wot) + ot 
E,® = fe: a(t) > B{t)) - Et 


Then we can find 5,*> 6," 6,8: §)*: é,", é,° all> 0 


such that for: 


Zl 





Met le ale “yc GS eee yl) > 5/6 mT) 
9) oO 0) © Oo 
W WW W Wades W 
t€ 1° & m1 *)< 5. , mE AI) 2 5/6 mI") 
| g S71 8 g 
to E18 & mI 8) < Ps mE, A1*) 7 5/6 m(1_®) 
& m(L *)< § .*, mE 1, ) > 5/6 m(1,") 
W W W War Ws W 
ce 1,8 & mry4)< dh. mE NAIL") 7 5/6 mt," 
Zz eee yk & 5. eee 
tle 1, & m(T, VL &, : mE, Nt, Y> 5/6 mi, y 
We now take 4 such that: 
Ds << mine Ae Ot ek tO eG 
6, 6, 8. §, é, &” 
and mn and I, such that tie I. and ae Ls in aA = 2) and: 
(3) O< mL) = mL) <6 


Let: 


_-* W g 
(4) E Se. les ae L 


x W g 
ENE NEPAL, 
then: 
mE) = m(I) ~ mI -£) = m(I.) - m(T. - [z,"N=,N e J ) 
= mI) - n> EU, = e "U4, -e 8) 
Zm(i,) = Ge tere *y m(1, ee y - mI ~£ ng) 
| 1 
>m(1.) - 7 a(t) - : m(I,) - 6 
- 1/2 mi ). 
Oo 
Thus we have 
(6) mE.) > 1/2 m(1,) 
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and by the same reasoning we have 

(7) mE) > 1/2 m(i,) 
Using (3), (4), (5), (6) and (7) we obtain: 

1/2 m(E )S 1/2 m1) = 1/2 m(Ty< m(E,)< m1) = m(I,) <2 m(E,) 
or L/2 mE, < a(E,)< 2 mE.) 


and since m(E,) > 0 we can write 





2S < 
mCE.) 
Next define 
OF mE, ) 
x Co ee ee a n 
| Cae es i 

x (t) = x(t) - € on Ey 

x(t) elsewhere. 


We observe 


f 


on E : xbeey = x°(ep + ¢ MED & x (ty + 2E 
7 
0 


a(t.) -E < g(t) 


on ES 2 h(t) x°(t) -ED>ED 0 


x (ty = x%(t) -E< x(t) S g(t) 


i =) mE) 
and fs [> -- | € e 
> BES Ey - fx + Em(E, ) 2 € m(E, ) eG: 


so xt £& xX. 


Now since x°(t) maximizes our integral we can write: 
© Loa 
free mm (t> > fre) x (ty 
and using the definition of =o this becomes 


Zo 












WEL, —— 
~ ee 2 mE.) E 
Ei 


but E. and om were chosen such that 


W(t) > Wit.) -¢ wm E. 


Wity < WCC, om Onk Ey 


so we have upon dividing both sides of (8) by E : 
m(Ey ) 
(W(ty AO) MEV)D | Wle)PATESY | W(EY? (W(t,) - T)OLE,) 
aa Ey 
Upon dividing through by mE, ) which was chosen to be non zero we 
obtain 
W(t, to 2 W(t) -@g where g-is arbitrary. 
Thus WCC, ) Z W(t, ). 

Simce all we required was that x (ti)> 0 and x (t,) €e(t,) we 
can see that 1f also aCe y> 0 and Ce Jee es) we can obtain the 
reverse inequality in the same manner, thus obtaining W(t.) = W(t) ). 
Taking A to be this common value we obtain the conditions: 

w(ty > A if x°(t) = a(t) 
wit) = A if O Sx) <S alt) 
w(t) S A Le x°(r) = O 

These conditions hold for all points at which x, W, and g are 
approximately comtinuous and hence a.e. and the necessity is proven. 

With this lemma we are now ready to prove our first theorem. 
Theorem V. Given g and X as before and a function £ defined on Eel 
(or at least that portion having non-negative first coordinate) such 


that fy Cx(t) ct) (the first partial derivative by the first coordinate) 
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| | . O 
is an integrabice function of t for all x»@ xX. If x (t) maximizes 
frccey.e) over x € X, then there is a number A such that for almost 
all ts: 

, oO 
yi if »x (t) = g(t) 


Xn t€ 0 Sx (tV <S Br) 


\V 


Q 
fC (t),e) 


V4 


< Rif x(t) = 0 
(The problem and constraints set forth in the above hypothesis shall be 
referred to as "the Basic Problem" throughout the remainder of this sec- 
tion.) 
Suppose x (t) maximizes the integral subject to the constraints on 
X. Then let x (ry be any other function from X. 
Define 
x(t) = ene (1-O)x (t) 
for OSO<E¢ 1 


Obviously x%c) EX for all SE [0,1). 


« 
Let FCO) = [ec (ty,t) = [ ox'+ 0-6) x , t) 
Now since x” maximizes the integral, F(@) has its maximum at O =0 and 
Since f, exists dF/go exists for 6 € [0,1] (we take the derivative from 


the right at 0 and from the left at 1). So dF 


Fe eel 


dg ™ 0 
must be negative. But: 


oes = [corsa - @)x,t) [x* - x°] 


, i 
= Jerw.oLex - x) < 0 
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But this is the problem stated in the lemma with 
W(t) =< f (x(t), t). So by application of the lemma the theorem is ob- 
tained. 

When the function f(x,t) has convexity or concavity properties we 
can determine even more about the nature of the maximizing solution as 
the following theorems will show. 

For simplicity we shall consider two functions that differ on a set 
of measure zero to be equal in the following three theorems: 

Theorem VI. Given the basic problem, if f(x, t) is strictly decreasing 
in x for all t, then there exists a number X» such thats: 

x (t)> 0 if and only if £,(0,t) >A 
where x°(t) is the maximizing solution. 

a. x(t) >Od£,(0,t) >A? 

Since fy (x,t) is strictly decreasing we have for x (t)> 0 
(CL) £,(0,t) > £, Ge (t,t) 
From Theorem I we have 
(2) x(t) > O SPEC (t),=y> A 
Combining (1) and (2) we obtain 
£.(0,t) >A 
b. £ (O,ty>A =x (ty > 0: 
or equivalently x°(t) = O=> £,(0,t)<A 
but this is the conclusion of Theorem V. 
Theorem VII. Given the basic problem, if £,(x,t) is strictly increasing 


in x for all t and x°(t) is a maximizing solution, then 
a( fe: 0 <x (t) < a(t)}) = 0. 
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Proof: Suppose we have an x(t) such that ms} m(fe : 0<x(t) cy (tO. 


© and g are approximately 


Let t) & t, be distinct points of S such that x 
continuous at t, & tg. Recalling the variational technique employed in 
Lemma I we take H = 1/4 and €& > O such that: 
x(t) +4 ES 2(ty) 
x (to) + 4E < aBlty) 
Mcp Oe 
x (ty) > 3E 
De fine: 
gy = fez |x%ey - xcei<et 
gE: ft: g(t) > a(t) -ES 
Es = fr o fx(t) - x°(ty/<E f 
E,® = ft 2 g(t) > g(t2) - ES 


We then find b*; 6,8, &,%, 6,8 >0 such that: 
for ty € 1,* & m(1,*)< 6%, m(E\*N1,")> 3/4 mt *) 
t, € 2,7 & mr, < by, mE, FV 1,8) > 3/4 mcr, 8) 
to € I," & m(1,*)< oie mE, () I,*) 2 3/4 m(I5*) 
to E 1,8 & m(1,8)¢G,%, mE BA) 1,°) 7 3/4 m(12®) 
| uc i x & x y 
Now select 5> 0 such that &< min 6 : 6, : , , 6, ) 


and [, &I such that ty E i. : to€ 15; 


L 2 
ene) I, : p and m(T,) z ms) = 3 : 


: = x ee 
Lets EF, = E, (VE, f) L, 


a x g 
By = Ey () Eo°f) I, 


2] 





Now: m(E,) = m(Z, ) -m(I,- Ey) = m(1,)- mL, - (EN E,8)) 
e aI) - m({1, - 2G) fi, -E,8]) 
Zm(T,) - m(T, ~ E*)~ mT, - £,8) 
>m(1, y+ 1/4 m1.) = 1/4m(1,) = 1/2 m1) 


Similarly we obtain m(E,) > 1/2 ma(1.,) and as before we obtain the 





inequality: 
1/2 
>; vhs wah <2 
Now define: 
x (t) + € , on E, 
i m(Ey ) | 
x (t) = rey - Dee » On E, 
p OT Ras 
x (t) , on (EU E,) 
x(t) -§ , on E 
Ut) : x Cty ee E& » on E, 
m(E5) 


Oe 
x (t) ; on -(E,VEs) 
We observe: 


1 
on Ey: x (t) = x°(L) +E > x (t) 2 0 


f 


x(t) s x (tyre < x°(ty) + 2 <a(t,) -E < a(t) 
x(t) 2 x(t) -E > x'(tg) - 2E > 0 
x@(ty = x(t) -E SS x(t) € git) 
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0 





on Bae x (ty s x%(ty - MEDD 5 > x% (ey - 2E>x%(e,) - 3ED> 0 





m(E>) 
wry s x(t) - “Eye x(t) g(t) 
x2(ty © x(t) + sats > x(t) 2 0 
ees oO, m(Ey) 
x (t) = x (t)+ (SCA es CLT rE <x (t pF 3€ < alr) 


m(E>) 
: ; a & = m(E,) f= x” 
Ey mea) E, 


2 Ke) m(E,) . © 
x fee iap fe - cal % 


2 
Thus are Se Gen 


l 2 
We now observe that x(t) 2% (t)+ x (t) 
Z 


~E< g(t). 


4 
it 








but, since £ is comvex Cf (x,t) is strictly increasing in x) we have: 


f(x (t,t) < L/2 ext cep ty + 1/2 E(x7(t) ,t) for all t amd thus 


fracas < Lie frown uz f soe (ty,t) 


l <3 | | O 
so that either x or x (or both) ylelds an integral greater than x . 
fe) oy 
Thus any x such that m( )- ¢O0<x (ty< eg (cyt )>0O0 cam not be the maxi- 
mizing solution and the theorem 15 proven. 
Theorem VIIL. Given the basic problem with f(x,t) twice continuously dif- 


ferentiable by x. If *° (tr) is the maximizing solution and we let 
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th 


jes £yGx°,0) > 0¢ 


So(x ) = fe: 0 <x (ry < g(t) § 


S08) 


and S(x°) = Se SoC) then m(S(x°)) - QO. 
Proof; Suppose we have an x(t) such that m(S(x ))> 0. 

on S(x°) choose E (8) > 0 such that: 

x (t) - E(t) > 0 

x(t) E(t) < g(t) 
and E(t) >0O such that: 

for x(t) - E(t) S x(t) S x°(e) + EA (EDs LG el> 0. 

This cam be done since ES is continuous, 
Let E(t) = min(€(t), E5(t)). 


Now consider the problem: 


(Ll) Maximize [tee subject toe 
S(x°) 


(2) [x : [ #00 
S(x°) S (x?) 


o rae: 

(3) x (t) - E (ey S x(ty Sx (te) & E(t) 
If x(t) maximizes the original imtegral, then if we let x*(t) = x°(t) 
restricted to S(x°) , x* (t) must provide a maximizing solution to this 


new problem. 


Lf we now let y(t) = x(t) = x(t) + E(t), we obtain: 
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(L') Maximize f(y(t) +x (ty) - E¢ty, cy 
S(x?) 


Subject to: 


(2') fro: Ge) 
S(x°) S (x°) 


(3") OSy(t) S$ 2E(t) 
We mote that f(y(t) + x(t) -~€(t), ty) can be written hfy(t), ct) 
since x° and E are fixed functions of t. We further see that 
hy (yey ty = £¢y(t),t) and ye ee z f,,(y(t),t) so we have 
hy Cv(t),t) DO on Six) 
and by Theorem VII for y~ to be a maximizing solution we must have 
y°(t) = O or 2€ for almost ali ct in S(x°). But: 


y(t) < O implies x*(t)y = x°(t) & E(t) 


t 


y(t) = 2E implies x*(ty = x°(t) - E Cr) 
Thus any x(t) such that m(S(x°)yy > 0 can not be the maximizing solution 


to the original problem and the proof is complete. 
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Di. Examples of the Continuous Case, 

In this section we shall illustrate some applications of the theo- 
rems of the last section by means of examples and shall cite references 
for further reading for the interested reader. We shall use as our 
primary example the problem of search as formulated by B. 0. Koopman fiz). 
& study of Koopman's article and his indicated generalizations will make 
readily apparent how much less restrictive the theorems of Section 4 are 
than similar theorems from the calculus of variations. We shall also 
show the Neyman-Pearson lemma of statistics to be a special case of 
Lemma I when the selection of a most powerful test of a hypothesis is 
looked upon as an allocation problem. 

Example 1. The Koopman Search Problem. 

Suppose we are searching for an object which may be represented as 
a point on the real line. We desire to apply a fixed amount of search 
effort along the line in such a manner as to maximize the probability of 
detecting the object. Detection can be represented as a Bermoulli trial 
with a parameter dependent on location, X, and effort gp . More specifi- 
cally the conditional probability of detection with effort D (x) given 
the location of the object is in fact x is assumed to be (le 7 O(x)y, 
(This assumes that all portions of the line are equally susceptible to 
search, which assumption could be deleted.) Assuming X has the marginal 
density function p(x), we have the unconditional probability of detec- 
tion P(D) given by: 

P(D) = caer? pas 
So our problem is to find D(x) that will maximize P( PD) subject 


Co: 
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We now observe that in the terminology of Section 4 we have: 


(3) £(@, x) = p(x)(1 = e7 90%) 


(4) Eg(®, x). S p(xjye” 2) 


(3) fg 4(,x) = of ee 20 for bx 
From (5) we see that Theorem VI applies wherever p(x)>0O and where 
p(x) = 0, P(x) obviously will be zero, so we can assume Theorem VI to 
hold throughout. So we know that there is a number A such that: 

(6) P(x) >0 iff p(x) >A 
Since we have no upper bound on D(x), (a(x) = coo) we also have from 
Theorem V and (6): 
- O°(x) = A for p(x)> A 
@°(x) = 0 for P(xyS A 


p(x) e 
(7) 


Taking logarithms of both sides of the upper equation in (7) we ob- 


tain: 





p(x) = ln os for p(xpy >A 


0 for p(x)< A 


from (2): 


D: [e (x) dx = in PSY ax « (in p(x)- InA) dx 
erin ¥DP(X)OA 


Thus we can use the following graphical method to find the solution 


p(x). 
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Step (1). Graph in(p(x)) for all x at which p(x)>0O this graph 


may look Like Fig. lL. 
In (PQQ) 


| fa LU 
ml A ae 





Figure lL. 


Step (2). Draw a horizontal Line £ parallel to the x axis and move 
it up and down until the area (shaded in Fig. 1) above the line and under 
the curve In (p(x)) is equal to @ - Mark off A = (Ay sfigreee) the projec- 
tions on the x axis of the segments cut off from L by the graph of 
in(p (x) ). 

Step (3). D(x) = 0 outside of Ay sAgoee- Inside these intervals 
PO (xjz21n p(x)- in(A) is equal to the length of the vertical segment 
from 2 to In(p(x)) for the x in question, 

This completes the solution to the problem. However, we can obtain 
further information which might prove useful. 

Step (4). Graph on the same graph p(x) and the line y = A (Fig. 2) 


Px) 


(j-p) PU) - UY 
(>, \ fu vib 


vaya er 


wiehre 2, 
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Then the area (shaded in Fig. 2) above a and below p(x) is the 
probability of successful search, P. The a-postiori probability density 
of the location of the object p(x) is: 

P(X) _p for x ¢ A 


p(x) = 
Ai3-P for x EA 


So, if after an unsuccessful expenditure of effort fa new quantity 
g of effort becomes available, its optimum distribution can be computed 
using p'(x) instead of p(x). In this case (exponential) it turns out that 
our optimum probability of detection for allocation of D+F units of 
effort is the same whether we apply it in successive Stages or all in one 
stage. 

Example 2, The Neyman-Pearson Lemma. 

We shall now show that the Neyman-Pearson Lemma of Statistics is an 
application of Lemma I under suitable identification. 

Suppose we have observations taken on n random variables (or as is 
usually the case n observations of the same process). We desire to 
test the hypothesis that the joint density function £(X) »Xq0200%X, ) is a 
given function f, against the alternative that CX) vXa000 eX) is amother 
function f, at significance level Xx, 

By Significance level CX we mean we want the probability of reject- 
ing the hypothesis when it is true to be less than or equal to. If 
we define the power of the test to be the probability of rejecting the 
hypothesis when the alternative is true we might them desire to find a 
criterion based upon the observations that will maximize the power for 
the given OQ. If such a test exists, it is called the most powerful 
level & test. 
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If we het € 2 (X;,%95ee-%,), we have the probability of rejecting 


the hypothesis when it is true is [ fote> where A is the set of points 
A 


t whose observation would cause us to reject the hypothesis. Thus a 

test (or procedure) is a selection of a set A (or a partition of En) such 
that we reject the hypothesis if the observation x lies in the set A. 
The set A, so determined, is called the critical region. Similarly the 


power of the test may be written: { £ (ct). 
A 


Our problem then is to find the set a° that yields the maximum 
power for our level & test. Letting C, be the characteristic function 
or the set A our problem is to: 


maximize fac C(t) The power of the test using critical 
region A 


subject to; (1) 0O <c,< 1 


(2) [eco Ci(t)<a The test must be of level & . 


We mow Lets: 





x(t) = f(t) Cy (t) 
fF, (ct) | 

wit) 2 L If £ (t) were zero we would obviously 
f(t) reject the hypothesis upon observation.of 


t, so we cam restrict our problem to the 


region wherein f,(t)>0O. Thus we shall 
assume £,(t) > 0 throughout the problem. 


Our problem now becomes: 
(3) maximize fucerece) 
subject to: (4) 0<= x(t) < f(t) 
(5) [xo | 
Since W(t) is non-negative we can without loss of generality write 
(5) ase 
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(9) fxcey = a 
Application of Lemma I to the problem of (3), (4) and (6) tells us 
that for x? (t) to be a maximizing solution there must be a number A 
such that if 
O 
(7) >A >, * (t) 
W(t) As CE) 


f(t) 
o 


0 


=A, x°(t) is undetermined. 


Substituting for x°(t) and W(t) in (7) we obtain: 


£,(t)} =A , Cro(t) £,(t) 


£,(¢) 
(83) if FC) 


<A, C,0(t) £,(t) = 0 
= i» ,» undetermined 

Recalling the meaning of A(t) we have the conclusion that the most 
powerful test of hypothesis at level QA consists of determining a number 


A (depending on fj, f. and Q) and to; 





Pek WE sadn £,(t) 
reject the hypothesis E(t) 
—. ae £0) 
accept the hypothesis if —lL— ¢ A 

£,(t) 
ar a 

we have no test if if ) = A ° 
£,€t) 


where t is the observed vector. 

These two examples, while more meaningful than those of Section 3, 
certainly fall short of illustrating the full power of the theorems of 
Section 4. The interested reader can find much more sophisticated and 
meaningful examples in the papers by Danskin and Gillman [3] and 


Danskin [4]. A particularly interesting problem is investigated by 
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Karlin, Madow, and Pruitt [10] who attack the problem of determining 
optimum firing rates as a function of range for a weapon of given charac- 
teristics against a particular type of target and then proceed using 
these maximum payoff functions to consider optimum mixes of several 
types of weapons against supposed mixes of targets subject to an overall 
cost or weight restriction on the weapons, A recently published attack 
on this same class of problems but more restricted than the one of this 
paper can be found im the article by Zahl fia} : 

For the reader who is interested in a particularly thorough discus- 
sion of the approach to problems of this type the two-volume set of 


books by Karlin [9] is recommended, especially Chapter 8 of Volume II. 
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